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Abstract 

This technical report describes a series of three studies designed to 
instruct students in the relationship between texts, comprehension questions, 
and two sources of answer information — the text to which a given question 
refers and their own background knowledge* The focus of the technical report 
is on individual differences in the amount and type of instruction most bene- 
ficial to students from fourth through eighth grade* The studies demonstrated 
that for the younger students, a longer (i*e*, 6-8 week) instructional program 
was necessary, with gradually decreasing amounts of instructional time re- 
quired as the students' age level increased* The studies also represent a 
continuum in instructional research that begins with a training study — in 
which instruction was conducted in classrooms by a university researcher — and 
moves to instructional studies — in which the training program was implemented 
by classroom teachers in their own classrooms* 
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DEVELOPMENTAL ASPECTS OF TRAINING STUDENTS 
TO USB INFORMATION-LOCATING STRATEGIES 
FOR RESPONDING TO QUESTIONS 1 

Taffy E* Raphael^ 

Students spend a great deal of their day in question-answer exchanges 
with their teacher, one of the rsost co&mon of which Is answering comprehension 
questions after reading &to 'ics and texts* The ability to answer these ques- 
tions is often the means by which students are labeled skilled or unskilled 
readers* Rese/irch (Garner, Wagoner, & Smith, 1983; Raphael, Uinograd, & 
Pearson, 1980) has suggested that less skilled readers do not have clear 
strategies for answering comprehension questions* It is obvious that the 
ability to answer a comprehension question will depend largely on whether or 
not the student has the appropriate information available* One less obvious, 
but perhaps equally Important factor is students* knowledge of the sources of 
information on which they can draw* These sources may be internal (in the 
readers* knowledge base) or external (in the text or other outside sources)* 
Knowing where such information sources are may be fundamental to the skillful 
answering of comprehension questions* 



i This paper combines data presented at the Montreal meeting of the 
American Educational Research Association and the Detroit meeting of the 
Society for Research in Child Development, April, 1983* Separate manuscripts 
detailing the methodology and results of each of the three studies included in 
this article are available and can be obtained by writing to the author at 446 
Erickson Hall, KSU, East Lansing, MI 48824-1034* 

^Taffy E* Raphael is an assistant professor in the Departments of 
Counseling, Educational Psychology, and Special Education and of Teacher 
Education in MSU's College of Education* 



One aspect of developing successful strategies for answering questions is 
students 1 ability to detect the contingent relationship between finding an 
appropriate answer, which is the goal of a question, and the various means by 
which the goal can be reached* The more explicit the question and the answer 
(i*e*, words that make up the question and words used to answer it both can be 
easily found In a single sentence of text), and more likely the student will 
be to deduce both the relationship between a question, its answer-information 
source > and the more general procedural knowledge that characterizes question 
answering* In questions with less clearly defined answers (i*e., the question 
requires tne reader to integrate several sentences in order to answer it ap- 
propriately), it would be more difficult to deduce this relationship. Since 
the relationship between the various means and goals in answering questions is 
not always obvious, it is likely that the development of an awareness of this 
relationship can be enhanced through the processes of mediation ^nd instruc- 
tion. The idea that children's cognitive activities are initially mediated by 
social others has longstanding and widespread theoretical support (Mead, 1934; 
Rosenthal & Zimmerman, 1978; Vygotsky, 1978; Wertsch, 1977). 

This paper describes a series of three studies (Raphael & Pearson, 1982; 
Raphael, Wonnacott & Pearson, 1983; Raphael & McKinney, in press) designed to 
test whether heigntening students* awareness of sources of information through 
the mediation of an instructor would enhance their comprehension of text s8 
measured by their ability to answer comprehension questions. ^ The mediator 
provided a support structure around the question-answering task. This was 



^These studies are published in their entirety as listed above* Pilot 
studies referred to in this psper (e*g*, when testing materials) vere part of 
the Raphael & Pearson (1982) study. 
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th^n gradually removed as students' need for such support diminished* Across 
this aeries of studies, my colleagues and I have examined the usefulness of 
instruction both developmentslly and across ability levels* The studies range 
from an initial set of training studiea in which the intervention was con- 
ducted by an educational reaearcher, to instructional studies in which the 
intervention was introduced by classroom teachers aa part of their develop- 
mental reading program* In describing this series of studies, evidence will 
be presented suggesting that the need for mediation varies with developmental 
level and question go sis * 

Experiment 1: Training Sixth Grsde Students 
Because the same training materials, method of instruction, and dependent 
meaaures developed for the first study were used, with minor change, through- 
out this experimental series, they will be described in some detail here* The 
purpose of this first study was to test the efficacy, for sixth-grade stu- 
dents, of a three-day Intervention concerning sources of information for 
answering comprehension questions* 

Method 

Subjects * Fifty-nine sixth-grade students whose ability level had been 
determined through a combination of standardized tests and teacher judgment 
were randomly assigned to either a training or control group* There were 10 
anbjects per ability level, with the exception of the low ability control 
group which had only 9* An analysis of variance (ANOVA) revealed no signifi-* 
cant differences within ability levels (high, average, and low)* 

Materials * All materials in this series of studies were basei upon a 
three-category taxonomy of questions proposed by Pearson and Johnson (1978)* 
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Thie taxonomy is unique in chat it classifies questions in relation to the 
sources of information used In answering them* If a question has an answer 
explicitly stated in the text, its question-answer relationship is text"* 
explicit* A question with an answer in the text that requires integration of 
information across sentences or paragraphs has a text-implicit, question- 
answer relationship* A question vlth an answer not in the text, but only from 
the readers * knowledge base is a script-implicit t question-answer relation- 
ship* The mnemonics Right There, Think & Search, and On My Own were used aa 
respective categories when working with the elementary and middle school 
students * 

Three booklets were developed to use during training, one per day* The 
first booklet was designed to introduce students to question-answer relation- 
ships* Based upon the concepts of shaping and fading (HiU, 1981), the book- 
lets began by providing a great deal of support for identifying the goals of 
questions and appropriate information for reaching these goals* First, brief 
texts (75-150 words), each followed by one question from each question-answer 
relationship category, were presented sequentially* The following were pro- 
vided for each question: the answer, the question" r relationship, and 
the reason for the relationship* The next set of examples also included pas- 
sages, questions, answers, and question-answer relationships for each question 
and answer, but the students had to provide the reason for the question-answer 
relationship* The next set of examples included passages, questions, and 
answers, and students provided the question-answer relationship and the reason 
for it* Finally, students were presented vith a series of passages and com- 
prehension questions, but had to provide an answer and the question-answer 
relationship represented using the following format, called the question- 
answer relationship task* 



What are three types of research oceanographers? 

Right There 

Think & Search 

On My Own 

Students wrote their answers on the line next to the question-answer relation" 
ship they felt the question and answer represented* 

The first booklet reflected this gradually decreasing support* The 
second and third booklets provided practice applying knowledge about question- 
answer relationships to longer and more difficult passages adapted from 
naturally occurring texts, with more reliance on independent work, as feedback 
became increasingly intermittant • 

Four passages were used, and each student read two* One was a passage 
read by all students, one was from a set of three passages including one pas- 
sage each at the fourth- and eighth-grade levels, and a filler passage that 
was not analysed* in this way, students could be compared when reading a com** 
tnon passage or when reading a passage at their reading level* 

Design * A 3 x 2 x 3 randomized block design was used with between- 
subjects factor* of ability and treatment and a wi thin-subjects factor of 
quest ion -answer relationship* 

Procedure * Students in the trained group received three days of instruc- 
tion* on Day 1, students were introduced to question-answer relationships in 
groups, with the author providing definitions and visual representations to 
help make clear the three question-answer-relationship concepts* Students 
were then led through the phases of the first booklet as described above* 
They received feedback on a group or individual basis, depending upon the 
activity, focusing on their explanation sccuracy, th»ir ability to recognize 
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the correct question-answer relationship when provided with a question snd 
answer, the completeness and accuracy of their answers when provided with only 
the question, and the consistency between their question-answer-relationship 
selection and the source of information for their answer (e*g*, if an On- 
My-Own question-answer relationship was selected, students 1 answers were from 
their knowledge base, and they answered the question well)* On the second 
day, students worked through the second booklet, which consisted of longer 
passages and more questions per passage* Ihe first parage was read orally by 
the instructor and students answered questions as a group* Following this, 
student? worked through the remainder of the questions on their own while the 
instructor gave individual feedback on question-answer-relationship selection 
and sccuracy of answers* On the third day, students practiced with s full- 
length passage divided into four segments, each followed by six questions (two 
from each question-answer-relationship category), which represented a typical 
basal reader story or content-area chapter* Students did the first segment 
Individually, then corrected the segments together in the larger group* The 
last three segments were completed individually and served as a criterion 
test. A fourth day hsd been set aside for individually tutoring those who had 
not reached a 751 accuracy level in question-answer-relationship identifica- 
tions, but all students were successful* The fifth day involved the experi- 
mental test* 

Str.dents in both training and control groups were tested on the same day, 
each responding fo a common passage and related questions and to a passage ap- 
propriate to their grade level* Story order was counterbalanced* For trained 
students, only directions to read the passage and answer the questions by 
writing answers on the blank next to the question-answer relationship repre- 
sented were provided* Control-group students received an explanation of 



definitions of th* three question-answer relationships, were reminded that 
some of the answers would not: be found in their texts, and then practiced 
identifying question-answer relationships on two brief texts with related 
questions* Then they too were asked to read the passages and answer the ques- 
tions on the blank next to the appropriate question-answer relationship* This 
introduction, used in pilot studies (see Raphael & Pearson. 1982). had been 
found to be sufficient for skilled adult readers to complete the task with 98Z 
accuracy and was considered to be the mini mum necessary to provide an adequate 
control group capable of responding to the question-answer-rel<*tionship task* 



Three dependent measures were used to assess performance levels* The 
first, hits, identified the number of correct quest ion-ansver-relationship 
identifications (e*g*. Right There for a text-explicit, question-answer rela- 
tionship)* This was a measure of the students' sensitivity to the task de- 
mands of a question* The second, pespon&e quality , examined the quality of 
the students* answers (e*g*. complete and correct, partial and correct, incor- 
rect)* This was a measure of the degree to which knowledge of information 
sources for answering comprehension questions influenced the quality of stu- 
dents* answers* The third, matches, indicated the degree of agreement between 
question-answer-relationship Identification and probable source of answer in- 
formation (e*g*. correctly identifying Right There when the information for 
answering the question was explicitly stated i:< text)* To create thia mea- 
sure, I established a matrix whereby students received a point for each case 
in which they correctly or incorrectly answered Right There or Think & Search 
for text-based questions* Similarly. I gave credit for each case in which 
students answered (correctly or not) from their knowledge base for a question 



Results 
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* they had labeled On My Own. Thla matrix indicated the degree to which 

atudenta had internalized the knowledge about queation-anawer relationships* 
With it, I considered the question, H Did the atudenta do what they indicated 
they ahould do?** 

Baaed on the three dependent measured, two 3x2x3 multivariate anal- 
ysea of variance (MANOVA) were performed, one each for the common paasage ana 
the reading-level pasaage aet. The between-aubjecta factora were ability 
(high* average, and low) and condition (trained and control), while the 
within-subjecta factor of queation-answer relationship was partialed into two 
a priori contrasta using Helmert *fi contraats in the multivariate procedurea 
described in Bock (1975)* Question-Answer Relationahip 1 contraated perfor~ 
mancea on explicit and the average of the two implicit queation-answer rela~ 
tionahipa, while Question-Answer Relationship 2 contrasted performancea on 
text- and script-implicit, queation-answer relationships. The Wilk*s lambda 
multivariate test of significance was used, followed by Roy-Bargman univariate 
step-down F-testa, where indicated* 

On the common-paasage compariaons, there were aignificant multivariate 
effects for ability, condition, and Quest ion-Anawer Relationahip 2, all of 
which were involved in a significant three-way interaction. The multivariate 
difference for Queation-Anawer Relationahip 1 could be accounted for by chance 
alone, as waa the case for the three two-way interactima* The follow-up 
examinations were performed, firat on the aignificant interaction, then on the 
aignificant main effects* 

The effect for the aignificant interaction could be attributed aolely to 
differencea on the measure of reaponse quality, F(2,52) * 8.77, £ < .01 (aee 
Figure l). Performance of students of high ability varied as a function of 
training only on the acript-implicit questions, with the high ability* trained 





9 



students scoring at higher levels than did the control-group students, but not 
differing as a function of training on either text-based question-answer rela- 
tionship. In contrast, trained students of average and low ability levels 
differed from their respective control-group students on text-based question- 
answer relationships only, showing no differences on script-implicit ques- 
tions. Finally, disparity between trained and control-group students in- 
creased as ability level decreased. 
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Figure 1. Response quality* on repeated measures on MAN0VA: ability x 
condition x question-answer relationship* 



In addition, trained students demonstrated greater sensitivity to task 
demands of questions (as measured by hits) and greater consistency between 
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10 

their information source identification and answer information source 
(matches) (see Table D* 

While the reading-level pas sage -set analysis revealed no multivariate 
effects f < > condition* trends in the means were similar to those in the common 
passage, particularly in measures of sensitivity and consistency (see Table 
1). 

Experiment 2: Training Fourth"Grade Students 
The second experiment consisted of two studies* The first % a training 
study, was designed to replicate the findings for sixth graders with a younger 
population* The second was an instructional study designed to both extend the 
training period and to implement these procedures as a part of the students 
on-going developmental reading program* The studies will be described sepa- 
rately as 2a and 2b* 

Experiment 2a; A Fourth-Grade Training Study 

Method 

Subjects * Twenty average fourth-grade students from three classrooms 
were randomly assigned co the training or control group* Analysis of variance 
using standardized reading comprehension scores revealed no significant dif- 
ferences between the two groups* 

Materials * The three booklets developed for Experiment 1 were used with 
minor changes in the passages so that none were above the fourth-grade reading 
level* Two test passages at the fourth-grade level with six questions from 
each question-answer relationship category were developed for use in testing. 
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Table 1 

Training and Control Group Means for Hits, Response Quality, and Matches 

Experiment I 





Hits 




Response Quality 


Hatches 




CP a 


LAPS b 




T AP^ 


CP 


T AP<! 

Ltfu *> 


Ability 


F<2,53)-10,36** 


F<2,53)-10,16** 


VO 1ft** 

r \ £ y JJ/^1?V JO 


r \ L y J J /™ h # LL 


VO 7 SS** 




High 

Average 

Low 


4,26 
3,60 
3,00 


4,44 
3,60 
3,42 


5.46 
4.62 
3.60 


5,22 
4,62 
4.74 


5.22 
5,04 
4,26 


5.34 
5,04 
4.65 


Condi t ion 


F<1,53)-12.56** 


F<1,53)» 3,99 


F<1,53)- 3.99* 


F(l,53>- 6,21* 


F<1,53)-13,60* 


F<1,53)« 5.11* 


Trained 
Cont rol 


4,02 
3,00 


4.08 
3.60 


4.80 
4.32 


5.10 
4.62 


5.28 
4.44 


5.16 
4.80 


QAR C (1) 
(2) 


F(I,53>- 1.15 
F<1,53)- ,10 


F<1,53)- 4,60* 
F(l,53)- 5,60* 


F<1,53)« ,26^ 
F(l,53)-75,79 


F<1,53)-11.24** 
F<1,53)-31.21** 


F<1,53)» 6.73** 
F(l,53)-28,46** 


F<1,53)-10.54** 
F<1,53)-15.35** 


Text Explicit 3,45 
Text Implicit 3,60 
Script Implicit 3.53 


4,14 
3,36 
3,96 


4,62 
5,10 
3,96 


5,16 
5,16 
4.26 


5,10 
5,22 
4.26 


5,28 
5,16 
4,50 



a CP m Common passage 
^LAPS « Level appropriate passage set 

c Quest ion-answer relationship (1) explicit versus implicit and (2) text versus script 



**£ < ,01 
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Design and procedures * A 2 x 3 randomized block design was used with the 
between-subjects factor of treatment (training and control) and the within 
subjects factor of question-answer relationship (text explicit, text implicit, 
and script implicit). Procedures were identical to those used in Experiment 
1. 

Results * Though it had been sufficient for the sixth graders, the three- 
day intervention did not appear to be sufficient for the fourth graders* 
There were no significant differences between students in the trained and 
those in the control group* To determine if the amount of mediation was the 
critical difference in the needs of these younger students, a second study of 
fourth-graders was conducted* 

Experiment 2b: A Fourth~Grade Instructional Study 
The purpose of this study was three~fold* First, I extended the length 
of the intervention to include an eight-week maintenance program, testing the 
effects of the longer training program when taught as part cf an on-going 
developmental reading program* Second, I tested the effects of training in a 
transfer condition in which a passage about dinosaurs "made to look like the 
science materials the students typically used—was distributed to teachers 
when students were not in school* The materiala made no mention of the 
question-answer relationships, nor were the questions followed by the 
question-answer relationship task* Teachers administered the materials stat- 
ing that they were beginning a unit on dinosaurs and the students were to read 
the passage to themselves and answer the questions* Third, the possibility 
that enhanced performance after the intervention could be explained solely in 
tetiss of practice effects had not been eliminated in previous studies, so I 
included a practice/training contrast in this experiment* 
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Method 



S ubjects * Participating in the study were 10 fourth~grsde teachers and 
180 of their students from a semi-rural western community* Six of the teach- 
ers instructed students in two treatment groups, while four of the teachers 
instructed students in two control groups* The participating students were . 
selected within schools from a population of 280 in tl.ree comparable ele- 
mentary schools (tvo trailing, one control school)* To insure that the 
randomization used in the subject selection process had resulted in equivalent 
groups, an analysis of variance was performed on the reading comprehension 
scores, revealing a significantly higher performance of the two control groups 
(no~treatment control and practice) compared to the trained students* Analy- 
ses of covariance were used when comparisons across these groups were per- 
formed with the ITBS^ reading comprehension score as the covariate* 

Materials * Training materials were the same as in the previous study 
except for the addition of a second set of materials consisting of eight pas- 
sages, each approximately 250 words in length and at a latp third-grade read- 
ing level, with six corresponding questions, two from each quest ion- answer 
relationship category* These were the maintenance passages used once weekly 
following the intensive training week* 

Four passages of 600-800 words each were used (two from the previous 
study of fourth graders) on topics rated in pilot studies as being familiar to 
fourth-grade students (e*g*, dogs, clowns)* The passages were created by 
making minor revisions to naturally occurring passages from trade books and 



ITBS stands for Iowa Test of Basic Skills* 




basal readers* Each passage was accompanied by 18 related comprehension 
questions, 6 each from the text-explicit, text-lmplidt , and script-implicit 
categories* 

Procedures: training group * Six teachers received a half-day inservice 
involving instruction in the three question-answer relationships, demonstra- 
tion of the materials that could be used to instruct the students, and model- 
ing of how the instruction should proceed* Half of the teachers received 
materials, and I made weekly visits to monitor their lessons and their 
atudentc 1 progress* The other half of the teachers did not receive materials 
but were taught how to create them from naturally occurring texts* They re- 
ceived weekly visits but were not observed and received no specific feedback* 
However, the differences la performance of those students whose teachers had 
received intervention and those who had not were mlnnor and will not be pre- 
sented here* Following the inservice, teachers implemented the intervention 
for nine weeks, at the end of which students were tested under a transfer and 
a maintenance condition* Recall that in the transfer condition teachers ad- 
ministered the test passage with its corresponding questions without mention- 
ing question-answer relationships or the training program* In the maintenance 
condition, I administered a test passage with corresponding questions followed 
by the question-answer relationship task with directions to complete the work 
In the way they had been practicing during their question-answer relationship 



Procedure: Control Group 1 — practice * Since significantly higher per- 
formance by students trained In question-ansver relationships could be at- 
tributed to their systematic exposure to questions from esch of the three 
question-answer relationship categories, a practice-only control group was 
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Included* This group received all passages and questions received by 
training-group students, but received no question-answer relationship train- 
ing* The students then participated in the testing period, which occurred at 
the end of the extensive training in the tteatment groups* They were given 
both the transfer and the maintenance passages, but neither passage included 
the question-answer relationship task* 

Procedure: Control Group 2 — no treatment * This group of students par* 
ticipated in the sane testing period as the treatment groups, received the two 
passages* -maintenance and transferrin the same form as the other control 
group, and were not exposed in any way to quest ion -answer relationships or to 
practice on the que* on-answer relationship materials* 

Results* Practice/ training contrast * Analyses of the students* response 
quality on both passages revealed no significant differences between the con* 
trol group and the practice-only group* Apparently, differences in perform* 
ance among students trained in question-answer relationships cannot be 
predicted on the basis of practice alone* Therefore, for all subsequent 
analyses, these groups were collapsed and treated as a single control group* 

Results of transfer test . A condition (Training 1, Training 2, and 
Control) x ability (high, average, and low) x quea tion*answer relationship 
(text explicit, text implicit, and script implicit) analyses of covariance 
revealed a condition x ability interaction, £ (4,124) 2*44, £ < .05, (see 
Figure 2) in which training effects were greater as reading ability decreased, 
replicating effects in the study of sixth graders* 

Results of maintenance test * There were no significant differences on 
the maintenance test, which raised a question about the presence of the 
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question-snswer-relationship task* In the study of sixth graders, both groups 
had used these prompts, and differences in performance favored the trained 
students* In this study on the transfer test, neither group had the prompts, 
and, again, differences favored the trained students* Yet, when the trained 
students used the task, and the control students did not, there were no dif- 
ferences* Therefore, one must question whether the two groups might, in this 
case, actually be performing two different tasks* The trained students were 
overtly identifying question-answer relationships and answering the questions; 
the control students were only answering questions* A question raised for 
future study, then, is "Under what circumstances will prompting by the 
questlon-answer-relatlonshlp task not interfere with answering questions?*' 

Experiment 3: A Developmental Instructional Study in Training 
Students to Recognize Different Sources of Information 

Since it was apparent that needs for mediation varied between fourth and 
sixth graders, a developmental study with second, fifth, and eighth graders 
was conducted* However, only the data for fifth snd eighth grade will be 
reported* The data for second grade had to be discarded for two reasons: (l) 
teachers had to change the training format from predominately written to oral 
since students had difficulty with the amount of silent reading, (2) students 
were not able to write their answers to open-ended questions due, probably, to 
the small amount of writing practice experienced in other classroom settings* 
To assess for possible effects, we did test the students after training using 
a multiple-choice format administered by their teachers, but this separate 
analysis of the data revealed no differences* Anecdotal data suggest that 
because of the amount of teacher assistance and students assisting each other 
these findings may not be valid* Hence, the study reported below can be re- 
garded as an instructional study conducted at two grade levels, with question- 
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Figure 2. Response quality on repeated measures of analysis of covariance: 
ability x condition, Experiment 2. 
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answer-relationship training implemented as part of ongoing developmental and 
English programs in fifth and eighth grades. My purpose was to examine 
developmental differences in a single experiment. Given that different levels 
of training were indicated by the previoua studies, with more rccdiation re- 
quired by the younger students, I predicted that students in the upper grades 
would require less than the three-day training period required in sixth grade. 
A second question concerned the developmental differences in using the 
question-answer relationship task. 

Method 

Subjects . Participating in this study were 112 fifth and 115 eighth 
graders from four comparable suburban schools. Student ability was determined 
by a combination of standardized test scores and by teacher judgment* and 
students were assigned to treatment within schools by classrooms. Group sizes 
ranged from 13 to 22. Analysis of variance revealed no significant differ* 
ences related to student ability. 

Materials * Based upon the teacher input from the instructional study of 
fourth graders* all teachers* who participated in an inservice in which they 
learned how to teach QARs to their students, received the three booklets to 
use with their students. In addition* they received six maintenance passages* 
These training materials were at the grade level of the participating students 
and were identical in format to those used in my previous studies. Three test 
passages with parallel fifth" and eighth-grade versions were created by modi- 
fying previous test passages. 

Procedures * Three stages occurred in this study: (l) teacher inservice 
of the type received by Training Group 1 in the study of fourth graders* (2) 
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eight weeks in which participating teachers who had received the inservlce 
used the first two weeks to have the students complete the training booklets 
and the Last six to complete the maintenance passages, (3) testing over two 
days, the first of which involved students reading a passage without the 
question-anawer-relationship task to cue them to the three types, and the 
second of which involved using the question~&nswer-relationshlp task* On the 
second day of testing, students in the control group received the orientation 
to question-answer relationships used for the control group in Experiment I* 

Results , Two analyses were performed on the dependent measures of hits, 
responses, and Batches, The first was a univariate ANOVA using the response* 
qusllty dependent measure avallat le from both test dsys. Thus, the following 
factors were present in the ANOVA; ability (high, average, and low), condi- 
tion (training and control), grade (fifth and eighth), question-answer- 
relationship (text explicit, text implicit, snd script implicit), and 
question~answer-reletion&hlp task (absence or presence)* A second analysis 
conducted 011 the data available from the second day only was a multivariate 
ANOVA using the three dependent measures of hits, response quality, and 
matches. Results, which involved the factor of condition, will be discussed 
by the dependent measures, response quality, and hits* There were no signifi- 
cant differences on the dependent measure, matches* 

Training condition was involved in three interactions, two from the ANOVA 
snd one from the MANOVA* On the ANOVA, the condition x ability interaction 
revealed results consistent with previous studies: Training was more effect 
tive for students of lower ability levels (1M Trained Average/Low « 4*03; H 
Control Average/Low ■ 3.83) than for higher ability students (M Trained ■ 
4*72; M Control ■ 5*02)* The significant, condition x grade x task interac 
tlon (see Figure 3) suggests that for the fifth graders, the presence of the 
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question-snswer-relationship taak enhanced the trained students' performance 
levGla, while decreasing the performance levels of the control group students* 
In contrast, in the eight grade, the preaence of the task decreaaed the 
trained students 1 performance levels and did not affect th<* performance levels 
of the control-group atudents* Perhaps the fifth-graders needed the extended 
practice before the task could aerve as an aid* The reduction in the eighth 
gradera 1 performance levels will be discussed below* 

The third interaction on the MANQVA involved grade and condition and was 
parallel to the finding on the ANOVA described previoualy* In the fifth 
grade, the training groupa 1 performance (M ■ 4*75) waa higher than Chat of the 
control group (M * 3*76) when the question-answer-relationship task was used* 
In the eighth grade, the orientation appeared to be more effective (M Trained 
* 4*21; H Control - 4*65)* 

On the treasure of sensitivity to task demands of questions, training 
condition interacted with both grade and question-anawer relationship* The 
condition x grade interaction was due to the greater effect of training on the 
sensitivity of fifth graders (H Trained - 3*94; H control - 3*14) than on 
eighth graders (M Trained - 3*89; H Control - 3.71)* Apparently, the 10- 
minute orientation wai? aufficient for enhancing eighth gradera 1 sensitivity 
to task demands* If this is true, it is likely that having to continue prac- 
ticing for six weeks created a problem in attitude* Anecdotal data from their 
teachers suggests that the eighth graders grew tired of answering questions 
when they also were required to label the question-answer relationships, a 
finding that may explain the reduced performance in response quality of the 
eighth graders when they used the question-answer-relationship task* The con- 
dition x queation**answer-relationshio interaction suggests that training was 
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Figure 3. Response quality on repeated measures of ANQVA: condition x grade 
x task, Experiment 3* 
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most helpful In sensitizing students to ths task demands of implicit or 
inferential (M Trained * A* 18; M Control - 3*2S) questions than for text ex- 
plicit questions (M Trained - 3*38; H Coiitrol * 3*78^ This is consistent 
with the fact that the students have •au'ih more exposure to and practice on 
text based and explicit questions (Gusacak, 1967; Hare & Pulliam, 1980), than 
on implicit or knowledge based ones* 

General Discussion 

The findings are applicable to three general issues: (i) the effect of 
training on students* sensitivity to the task demands of questions, (2) the 
effect of training on the quality of students' responses, and (3) the amount 
of training sufficient for improvement in both sensitivity to task demands of 
questions and response quality* 

The findings across the three studies suggest that training consistently 
enhances sensitivity to the task demands of comprehension questions, particu- 
larly when those questions require drawing inferences or integrating across 
textual information* That is, children's ability to correctly identify 
question-answer relationships improved as a result of training or orientation, 
depending upon grade and ability levels, and was particularly effective for 
enhancing recognition of text-implicit relationships * 

Further, training enhances the quality of students' responses, most 
notably under transfer conditions in which students are not cued by, nor re- 
quired to respond, using the question-ansver-relationship task* When both 
trained and control students are cued by the task, their performance levels 
vary ag a function of age and ability* It may be that this specific finding 
reflects a developments! curve such that with the youngest students, the 
longer training period is useful, but having to use the question-answer- 
requirement task in addition to just answering the questions may have been 
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more than they were capable of doing* With the middxg range of students, the 
training time may be shortened, and the use of the task prompts them to higher 
performance levels* With th* oldest students in this studies, the training 
period may be reduced still further, and the use of the task becomes counter- 
productive* 

More specifically, younger students require a longer and more intensive 
training period than do older students* This can be seen in the gradually 
decreasing amount of training required as students' age increases, with the 
minimal training of a brief orientation facilitative in eighth grade, a three 
day orient st ion being adequate in the sixth, and a longer (up to 8 weeks) 
training period facilitating performance of fourth and fifth graders* The 
important point to note here is that more is not unconditionally better* 

It has bien suggested that it is important for meana or strategies to be 
used as ends in and of themselves before they are used as means in the service 
of some higher goal (Smirnov £ Zinchenko, 1969)* Yet once a strategy is 
learned as an end, a longer training program may create a sufficiently nega- 
tive attitude such that performance levels when using the strategy as a means 
may actually be reduced* This has important implications for classroom in** 
struction. There is often a tendency to think "When in doubt, practice more." 
The findings of theso studies suggest that it is critical to consider careful- 
ly the amount of exposure and practice appropriate at a given grade level* 
While additional practice can be a valuable tool to lead students to the point 
of overlearning and eventually automaticity, teachers mat use practice in 
auch a way that their students' attitude towards uaing the strategy does not 
undermine their willingnesa to employ it when it is reasonable to do so* 



9 

ERLC 



29 



24 



References 

Bock, R* D* (1975)* Multivariate statistical method In behavioral research * 
New York: McGraw-Hill* 

Garner, R*, Wagoner, S*, & Smith, T* (1983)* Reading Research Quarterly , 18 
(4), 439-447* 

Guszak, F* J* 0967)* Teacher questioning and reading* The Reading Teacher , 
21^, 227-234* 

Hare, V*, & Pulliam, C* A* (1980)* Teacher questioning: A verification and 
an extension* Journal of Reading Behavior , 12, 69-72* 

Hill, F* (1981)* Principles of learning * Palo Alto, CA: Mayfleld* 

Mead, G* H* (1934)* Mind, self> and society * Chicago: University of Chicago 
Press * 

Pearson, p* D*, & Johnson, D* D* (1978)* Teaching reading comprehension * 
New York: Holt, Rlnehart, & Winston* 

Raphael, T* E*, fir McKlnney, J* (In press)* An examination of 5th and 8th 
grade children's question answering behavior: An Instructional study 
In metacognltlon, Journal of Reading Behavior * 

Raphael, T* E*, & Pearson, P* D* (1982, March)* Metacognltlve training 
In question-answering strategies (Report No* 238)* Champaign , IL: 
Center for the Study of Reading, University of Illinois* 

Raphael, T* E* , Wlnograd, P*, & Pearson, p* D* (1980)* Strategies children 
use when answering questions* In M* Karoll & A* J* Moe (Eds*), 
Perspectives on reading research and Instruction * Washington, D*C* : 
National Reading Conference* 

Raphael, T* E*, Wonnacott, C* A*, & Pearson, P* D* (1983, July)* 

Metacognltlve training In question answer relationships: Implementation 
In a 4th grade developmental reading program (Report No* 28471 
Champaign, IL: Center for the Study of Reading, University of Illinois* 

Rosenthal, T* L* , fir Zimmerman, B. J, (1978)* Social learning and cognition* 
New York: Academic Press* 

Smlrnov, A* A*, & Zlnchenko, P, I* (1969)* Problems In the psychology of 
memox'y* In M. Cole & I* Maltzman (Eds*), A handbook of contemporary 
Soviet psychology * New York: Basic Books* 

Vygotsky, L. S. (1978)* Mind In society: The development of higher 

psychologlcal_processes * Cambridge, MA: Harvard University Press* 

Wertsch,- J* W* (1977)* Metacognltlon and adult-child Interaction* 
Unpublished paper, Northwestern University* 



9 

ERLC 



30 



